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Three-mode parametric interactions can occur in triply-resonant opto-mechanical systems in 
which two orthogonal optical modes are coupled with an appropriate mechanical mode. Using 
an optical cavity with a membrane inside, we report the first observation of three-mode paramet- 
ric instability in a Fabry-Perot cavity, a phenomenon predicted to occur in long baseline advanced 
gravitational wave detectors. We present a large signal model for the phenomenon, which pre- 
dicts exponential growth of mechanical oscillation followed by saturation. Our experimental results 
are consistent with this model. Contrary to expectations, parametric instability does not lead to 
loss of cavity lock, a fact which may make it easier to implement control techniques in Advanced 
gravitational wave detectors. 



In 2001, Braginsky ct al. [l|, HU predicted that the co- 
incidental match of the mode shapes of mirror mechanical 
modes and Lageurre-Gauss optical modes in the long op- 
tical cavities of gravitational wave detectors could give 
rise to three- mode parametric instability (PI). The high 
mechanical and optical mode density of these systems 
would ensure that such interactions would occur acci- 
dentally. Subsequently detailed modeling @ verified the 
predictions and experimental tests on suspended opti- 
cal cavities 041] demonstrated 3-mode interactions be- 
low the instability threshold. 

Three-mode interactions mimic a two-level atomic 
system 0, in which parametric instability is analogous 
to the creation of a phonon laser. Bahl et al.[|| empha- 
sise that the phenomenon is a macroscopic realisation of 
Brillouin scattering. 

The challenge to observe the phenomenon in a free 
space optical cavity coupled to a mechanical resonator 
can be met either by using very high optical power in 
large scaled optical cavities, or at low power in tabletop 
cavities with suitable mode structure and a low mass high 
quality factor mechanical resonator. A free space cavity 
with an intracavity membrane creates a suitable optical 
mode structure which in principle can be matched to the 
mechanical mode structure of the membrane. 

It has already been shown that silicon nitride mem- 
branes have sufficient transparency to be used in high 
finesse optical cavities, and have suitable simple me- 
chanical modes in the MHz range. Well understood 2- 
mode parametric instabilities have been observed in a 
suspended cavity @, microtoroids [Iol - fl2l ]. and micro- 
spheres mm. For 3-mode parametric interactions an 
optical cavity containing a membrane must be tuned to 
sustain a pair of optical modes spaced by a frequency 
equal to a chosen mechanical mode frequency of the mem- 
brane [l|, m] . The mode shapes of the mechanical modes 
are also well matched to accessible cavity modes. 



In this paper, we first present a large amplitude model 
of three-mode interactions and predictions of the time 
evolution of a mechanical mode amplitude and an opti- 
cal cavity mode amplitude. It reveals a regime in which 
the mechanical mode is amplified by the negative effec- 
tive resistance of the cavity system, and the transition to 
a regime where the amplitude grows exponentially until it 
reaches a saturation value. The cavity design and tuning 
techniques are described, followed by time domain obser- 
vations of the cavity high order mode amplitude. The 
experimental results confirm the large amplitude model, 
and reveal that the instability does not lead to the loss 
of cavity locking. The implications for advanced gravita- 
tional wave detectors are discussed. 

Large amplitude model of 3-mode parametric 
instability — All prior analysis of three-mode in- 
teractions has assumed 0, [i| UH, [H, [ID, [l9[ sma U 
amplitude. While appropriate for obtaining instability 
criteria this approach fails when the instability threshold 
is passed and the loss of fundamental mode power 
through scattering into high order mode becomes large. 

We develop our theory for the experimental system 
shown in figure [1] consisting of an optical cavity and a 
membrane in its centre, where two optical modes cou- 
ple to a mechanical mode via radiation pressure. This 
system can be described by the interaction Hamilto- 
nian H m t = -h\ OM x m {al + a* s )(a + as) , where x m 
stands for membrane displacement, ao and as are TEM00 
and TEM02 optical modes complex amplitudes, respec- 
tively, Aom < Awq M is the three-mode coupling strength 
and "less or equal" sign accounts for a non-ideal match- 
ing of both the optical mode and the mechanical mode 
shapes (overlapping factor A defined by Eq. (9) in (I(| ) 
and optomechanical coupling strength, lo'q M , showing the 
change of cavity resonance frequencies per unit displace- 
ment of the membrane. The latter can be calculated 
using the formula for cavity resonance frequencies as a 
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FIG. 1: (Color online) Three-mode interaction cavity with 
central silicon nitride membrane, of dimension 1mm x 1mm x 
50nm. An electro-optic phase modulator (EOM) and po- 
larised beam splitter (PBS) lock the cavity fundamental mode 
frequency using Pound-Drever-Hall (PDH) locking [24| . The 
membrane is mounted on the piezoactuator (PZT) to tune its 
horizontal position. The transmitted light from the cavity is 
monitored by an offset photodiode (PD) in order to detect 
the beat note between the fundamental mode and high order 
mode. 



function of membrane position derived in [17 
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where L is cavity length, r m and t m are membrane ampli- 
tude reflectivity and transitivity, respectively, Ao is laser 
wavelength. 



The full Hamiltonian for our system reads: 



(2) 



Here the first three terms describe the oscillatory dynam- 
ics of two optical and one mechanical mode, where b m 
stands for dimcnsionlcss complex amplitude of the mem- 
brane motion defined {bm + b^) with the zero- 
point motion amplitude given by x q = (fi/(2mtd m )) 1 '' 2 . 
Laser pump is described by the last term Hdrive = 



/2KoA p (aoe l1 



(jg-w^t) in which Kq is the TEMOO 



mode lincwidth and A p = \J Pi n j (hu) p ) and lu p are the 
pump laser drive amplitude and frequency, respectively, 
Pi n is laser power. 



For slowly varying mode amplitudes, 
following transformation b m — > b m e~ lu)m ' 



.e. making the 
a -> a e-^°* 

and as — > ase~ l " st , one can write down equations of 
motion as follows (equations for conjugate amplitudes 
can be obtained by applying complex conjugation to the 
equations below): 



ao + (y - i\oMX q [b m e- Wmt + ^e'"™']) a - iX MX q a s (b m + b* m e 2iUmt ) = i^A p , (3) 
hs + (T ~ iA ~ ^OMXgibme-' 1 ^ + b* m e iu ^}) a s - iXoMX^b^ 2 ^ + b*J = , (4) 
b m + \h m - iX O MX q (a a* s + (|a | 2 + \a s \ 2 )e iUmt + a^age 2 ^) = , (5) 

I 



with detuning A = ujq — — u m . 

If we drop all the oscillating terms in the above equa- 
tions and recall that pumping laser is locked to the 
TEMOO mode via a feedback loop with bandwidth much 
lower than mechanical oscillation frequency, we get the 
standard linearised equations of PI derived in |l6[ with 
TEMOO amplitude equal to Aq = 2i^/ P m / (ftw p K ): 

a s + ^-a s - i\ MX q A Q b* n = , (6) 
Kn + ~Y b m + iXoMXqAQds = . (7) 

Thereof one can immediately derive a parametric insta- 
bility condition, assuming solution in the form {a s , o^} oc 
e r * and requiring T ^ 0: 

K = 8A ° MPm > 1 , (8) 



The ringup time, with the assumption 7,„ <C K5, reads: 
Tr= ~ 4A 2 P ' (9) 

OM ™ 

Using this formula, we can estimate an optomechanical 
coupling strength for our system as Aom/27t = 0.84 x 
10 14 Hz/m, using experimental data given in figurelHl Us- 
ing ([5]) , one can also calculate a threshold value for input 
laser power P*^ res = 5.7 fiW at which PI arises. 

To explain the saturation phenomenon we need to ac- 
count for the omitted oscillating terms in <j3j) . It can be 
done by using the combination of the method of har- 
monic balance and the method of slowly varying am- 
plitudes. We look for a solution in the form A{t) = 
o-n{t)e~ m ^ mt where A(t) refers to the optical 
modes, ao, as and a n (t) denoting the slowly varying am- 
plitudes of the corresponding mode harmonics (slow com- 
pared with w^ 1 ). Substituting the above solutions into 
the initial equations © and doing lengthy but straight- 
forward calculations, we obtain the following equation for 
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the mechanical amplitude: 



b m + ^ ll-K 



J2 
J 



(kib m ) GqG* s 



l + k 2 G G s \b ri 



(10) 



where G = 1 - e - K °*/ 2 , G s = 1 - e-OWa-^)*, j„( x ) 
is the Bessel function of the order 0, k\ = 2\oyiX q /u) m , 
k 2 = (2\o M x q / y?KQKs) 2 {l — 2iA/ks). One can also de- 
rive expressions for the amplitudes of harmonics of both 
optical modes: 



O!0,n = Jn{k\bm) 



AoGoJoiki 
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as.n = -kzJ n {kib m ) 



k 2 G G s \b m \ 2 ' 
A G G s J (fc 1 b m ) 

l + k 2 G G S \b m \ 2 



(11) 

(12) 



with £>3 = 2Aom^ij/'*s. We see that the optical mode dy- 
namics is fully governed by that of the mechanical mode. 
We can also derive a steady-state amplitude of the me- 
chanical mode from Eq. (|10p , setting b m = and solving 
the resulting non-linear algebraic equation with respect 
to b m taking into account that Go.s{t —t oo) = 1. 
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FIG. 2: (Color online) Theoretical model for the time evo- 
lution of parametric instability, (a) the cavity fundamental 
mode; (b) the cavity high order mode; and (c) mechanical 
mode. Optical modes are normalised by the value of |Ao| at 
Pin = 10 fiW. The mechanical mode amplitude is given in 
units of Fabry-Perot cavity resonance linewidth in displace- 
ment. (Here \ p is the pump laser wavelength and J- is the 
cavity finesse.) 

The resulting dynamical evolution is given in figure [2] 
We see that as the Stokes mode and the mechanical mode 
ring up, the circulating power in the TEM00 mode goes 
down. When the mechanical oscillation amplitude ap- 
proaches the Fabry-Perot cavity linewidth, \ v jJ-. the 
system reaches saturation and all modes acquire steady 
amplitudes that depend on input laser power [20| . Fur- 
ther detailed analysis of parametric instability in the 
highly non- linear regime will be published elsewhere [2lj ] . 

Experimental observation of three-mode parametric in- 
stability — To observe the three-mode interaction, two 



relevant optical modes (TEM00 and TEM02 in this ex- 
periment) must be simultaneously resonant inside the 
cavity. To obtain maximum gain [l|, the frequency dif- 
ference between the two optical modes must be tuned to 
the mechanical mode frequency. The mechanical modes 
are modes of a silicon nitride membrane with frequen- 
cies spanning from 0.1 MHz to a few MHz. However the 
free spectral range of a lOcm-long tablctop optical cav- 
ity is in the range of GHz. The mode spacing needs to 
be tuned with a precision of ~ 10~ 6 of the free spectral 
range. This can be achieved with careful choice of mir- 
ror radii of curvature and cavity length. For our case, 
a near-confocal cavity (mirror ROC close to the cavity 
length) is tuned so that the frequency of the higher order 
TEM02,p mode close to the frequency of the next lon- 
gitudinal mode TEM00,p+l. Small length adjustments 
enable the resonant condition to be met. In the cavity 
with a central silicon nitride membrane shown in figure [TJ 
the membrane position provides a second way of tuning 
the cavity mode frequencies. The cavity resonance fre- 
quencies with the membrane in the middle, compared to 
the empty cavity, are shifted by an amount determined 
by the reflectivity and position of the membrane [l7| . 
given by = (cj Li) cos 1 [\r m \ cos(47rx/A)] , where x 
is the membrane position relative to the centre of the 
cavity. Figure [3] shows u cav for different cavity modes 
as a function of membrane position. When the mem- 
brane is within a quarter of the wavelength from the 
centre of the cavity, there are two frequencies crossovers 
between the TEM00 mode and the TEM02 mode, la- 
beled as "crossover 1" and "crossover 2". Tuning the 
membrane position in principle allows the mode spacing 
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FIG. 3: (Color online) Cavity mode frequency tuning, mode 
shapes and overlap. (a) mode frequencies as a function 
of membrane position, (b) The mode shape of the mem- 
brane^, 6) mode; (c) mode shape of the TEM02 cavity mode. 
The product of the three mode shapes (d) confirms the strong 
mode shape overlap requested to obtain the three-mode in- 
teraction. 
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between the TEMOO and TEM02 modes to be matched 
to the membrane mechanical mode frequency. In prac- 
tice, the crossovers are avoided due to coupling between 
the modes [12, Normally there exists a minimum 

frequency spacing at the nominal crossing point. The 
greatest challenge in this experiment was the adjustment 
of the membrane position and alignment to allow the 
minimum frequency spacing to be close to the chosen 
mechanical mode frequency. 

The second challenge for a three-mode interaction ex- 
periment is to design a significant spatial overlap between 
the mechanical mode and the optical modes. Figure [3] 
shows the amplitude distribution of one membrane me- 
chanical mode denoted (2,6), the optical cavity TEM02 
mode, and the product of all three modes ((2,6), TEM02, 
TEMOO). It is clear that there is a good overlap between 
these modes if the cavity modes are correctly positioned 
on the membrane at a specific location which is not at 
the centre of the membrane. The calculated maximum 
overlap factor is ~ 0.8. 

Our optical cavity was mounted on an invar bar in a vi- 
bration isolated vacuum tank. Motorised optical mounts 
and piezoactuators were used for cavity alignment. (De- 
tails available from the authors) . The experimental setup 
is as shown in figure [TJ We developed careful alignment 
and tuning procedures to tune the cavity. First the cav- 
ity finesse ~ 15000 was measured without a membrane 
present. Then the membrane, which had been previously 
aligned using a He-Ne laser, was inserted into the cavity. 
The maximum finesse observed with the membrane in- 
serted was ~ 13000. 

Tuning the optical mode frequency spacing was 
achieved by tuning the membrane position and orien- 
tation. We chose "crossover 1" labeled in figure [3] as 
the target because the membrane position happens to 
be close to a node of the TEM02 mode. In this loca- 
tion the membrane absorption is minimum, allowing the 
highest possible cavity finesse. We measured the depen- 
dence of TEMOO and TEM02 mode frequency spacing 
on membrane angle. The frequency spacing should be 
minimised when the membrane is normal to the incident 
light and was tuned at a rate ~ AM Hz / mrad. We tuned 
the membrane position along the optical axis to the de- 
sired "crossover 1" position, while the gap spacing at the 
avoided crossing was tuned by membrane angular adjust- 
ment. 

The measured membrane mode resonant fre- 
quency agrees with the calculated value of 
/ij = ^T/AptP^Ji 2 + j 2 with membrane tension 
T = 800 MPa and density p = 2.7 gj 'cm 3 . The indices i 
and j are the mode numbers. However the membrane 
frequency drifted over time. For example the (1,1) mode 
dropped from ~ 402kHz to ~ 384kHz over 1 year. At 
the time of the measurements reported here the (2,6) 
mode frequency was ~ 1718kHz. 

For the very low mass membrane and the high finesse 
cavity used in this experiment, the threshold for the para- 
metric instability is ~ 5pW. Hence the experiments had 



to be conducted at very low optical power. This means 
that the TEM02 mode is below the photo detector noise 
floor except when the mechanical amplitude has built up. 
The TEM02 mode was detected with a simple, partially 
shadowed photodetector since a quadrant photodetector 
was not available. 
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FIG. 4: (Color online) The cavity mode frequency spectrum 
when the mode spacing is tuned to the mechanical mode fre- 
quency. 
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FIG. 5: (Color online)The photodetector signal as a function 
of time at different input power level, which shows exponential 
ringup. This signal measures the beat note between the cavity 
TEMOO mode and TEM02 mode, and is an indirect readout 
of the mechanical mode amplitude. 

Using the tuning method described above we tuned the 
optical mode spacing to the (2, 6), 1718kHz membrane 
mode as shown in figure 2J As the optical mode spac- 
ing decreases, the cavity mode linewidth increases due 
to the coupling between the two modes 



22J. We fitted 



the tuning curve in the figure |4] to two Lorentzians to de- 
termine the corresponding mode linewidth. These cavity 
mode linewidths were used in the modeling results given 
in figure [2] The cavity stayed tuned long enough to make 
repeatable measurements, but frequency drift meant that 
retuning was required everyday. 

Once correctly tuned, exponential ring up of the (2,6) 
mechanical mode occurs whenever the input power ex- 
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Laser power (/iW) 

FIG. 6: (Color online)The photodetector signal ring-up time 
as a function of the input power. The solid curve is the curve 
fitting to the theoretical model. 

ceeds the threshold. Figure [5] shows the Stokes mode 
amplitude as a function of time at various input powers. 
Clearly higher input power corresponds to faster ring- 
up as expected. Figure [5] shows the ring-up time as a 
function of the input power. The ring-up time decreases 
with input power in close agreement with the theoreti- 



cal model. The saturation is clearly visible in figure [5] 
The mechanical amplitude reaches the cavity linewidth 
~ 10~ 10 to in a time between 0.1 and 0.5 seconds, in 
agreement with theory. The dependence of saturation 
amplitude on input power is also visible in the figure [6j 

Conclusion — We have shown that the theory of three 
mode opto-mechanical interactions correctly predicts the 
onset of parametric instability in a three-mode opto- 
mechanical system. The results are in excellent quan- 
titative agreement with the original theory of Braginsky. 
We find that mechanical mode amplitudes saturate in 
accordance with the large signal model for parametric 
instability presented here. In the system studied here, 
the onset of three mode instability does not lead to loss 
of locking of the main optical cavity. The loss of power 
from the main cavity mode is sufficient to stabilise in- 
stability. If the same behavior is observed in high power 
laser interferometers for gravitational wave detection, it 
should be much easier to implement instability control 
techniques based on feedback or slow thermal tuning. 
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